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Abstract 



This paper studies an irreversible investment problem where a social planner aims to 
control its capacity production in order to fit optimally the random demand of a good. Our 
model allows for general diffusion dynamics on the demand as well as general cost functional. 
^ . The resulting optimization problem leads to a degenerate two-dimensional singular stochastic 

Jjlj I control problem, for which explicit solution is not available in general and the standard 

QQ ' verification approach can not be applied a priori. We use a direct viscosity solutions approach 

^^ . for deriving some features of the optimal free boundary function, and for displaying the 

fT^ I structure of the solution. In the quadratic cost case, we are able to prove a smooth-fit 

^D ■ C^ property, which gives rise to an explicit identification of the optimal policy and value 

^ ^ function. 
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1 Introduction 

We are concerned with a singular stochastic optimal control problem motivated by a model of 
irreversible investment. More precisely, we imagine to deal with a social planner whose objective 
is to optimize some functional depending on the current demand of a good (energy, electricity, 
oil, corn, etc) and its supply in terms of production capacity. 

Problems of irreversible investment under uncertainty have been introduced in the economic 
literature by [23] and then developed by several other authors (see [HI Ch. 11] for references 
on this subject). From a mathematical point of view, such problems have been formulated as 
optimal stopping problems or, at a second stage of complexity, as singular stochastic optimal 
control problems, and have given a considerable impulse to the development of the corresponding 
mathematical theory. As references for the theory of singular stochastic control in context 
different from irreversible investment, we may mention the works [12^ \T9\ [20l [21] and |15[ 
Ch. VIII]. The mathematical literature of singular stochastic control applied to the subject of 
irreversible investment under uncertainty includes the works [S] U [5l El [lOl [TTl [131 IISI [281 EI] ■ 
The economic issue of costly reversibility has then been introduced and studied, among others, 
in [T|l^ll6 t ll7 tl22l[M] . In the papers mentioned above, the ones (substantially) considering two 
state variables (an uncontrolled one - possibly multidimensional - containing the noise, and a 
controlled one, representing the capacity) are [3l [H [T71 [22l [JH [281 I31)H More precisely, the ones 
dealing with a dynamic programming approach directly on the singular control problem and with 
the study of the associated Hamilton- Jacobi-Bellman equation (which in this case is a variational 
inequality) are [22l[2ll[31]. In particular, the papers [231[3l] consider an expected performance 
on infinite horizon with discounting over time, as in our case. However, the approach of [241 [31] 
is of verification type. In a singular stochastic control framework, this means that one has to 
guess some smooth fit properties of the value function at the optimal free boundary in order 
to look for a solution of the Hamilton-Jacobi-Bellman equation. Then one needs to prove a 
posteriori that the solution found is indeed the value function and, as a byproduct, one gets 
also the optimal feedback control. When this approach is applicable, it turns out to be very 
convenient, as it is theoretically fast (even if it may involve a nontrivial technical complexity) 
and allows a first understanding of the problem. Moreover, the presence of an explicit solution 
is an important tool to analyze the qualitative properties of optimal control and trajectory. 
On the other hand, one has to recognize that it presents two drawdowns. First, it is based on 
a guess, and so it cannot bring to a deep understanding of the structural background of the 
problem. Second, it works only when explicit solutions are available, therefore it leaves the 
problem completely unsolved most of the cases. 

In the present paper, we perform a direct study of the problem (without passing through 
verification type arguments) by means of a viscosity approach to the Hamilton-Jacobi-Bellman 



^The paper [3] reduces first the singular control problem to an optimal stopping problem and then applies 
dynamic programming to the latter one. The paper [T7| reduces first the singular control problem to an optimal 
switching problem and then applies dynamic programming to the latter one. Finally, we should mention the 
paper [30], dealing with a singular control problem with two state variables in a different context (consumption- 
investment under transaction costs). In this case the problem is approached by dynamic programming and by 
means of viscosity solutions to the associated Hamilton-Jacobi-Bellman equation. However, the regularity of the 
value function is proved by reducing the problem to dimension one, which is possible in that case due to the 
specific structure of the problem. 



(HJB) equation. To our knowledge, this is the first time that such an approach is used in the 
case of two state variables, in particular when the controlled state variable, here the capacity 
process, has no diffusion term, and so is degenerate!- Our approach allows us to keep much more 
generality with regard to the uncontrolled state variable (which is indeed a very general diffusion 
in the present paper) and to state the smooth-fit conditions of [24j as necessary conditions of 
optimality, i.e. prove that the value function must satisfy these conditional. More precisely, we 
show that the value function is C^ along the component of the controlled variable (Proposition 
I3.lt this easily follows from our assumptions by convexity arguments, just working on the 
definition of value function). Then, we prove that it has continuous mixed second derivative 
along the optimal boundary function (Proposition 15.1 1 and Remark l5.lt this is a deeper result, 
which invokes the viscosity property of the value function and requires the additional assumption 
()5.4p ). At the end, this machinery allows us to uniquely individuate the value function by 
Theorems 14.11 and 15.11 and solve the problem by Theorem 14.21 

The rest of the paper is organized as follows. In Section 2, we formulate the two-dimensional 
singular stochastic control problem and state the main assumptions. We study in Section 3 some 
first properties of the value function and of the optimal boundary, which is a function of the 
demand. In Section 4, by relying on the viscosity property of the value function to its dynamic 
programming variational inequality, we give a first main result providing the structure of the 
value function, and state a second main result yielding the optimal control in terms of the 
optimal boundary. Section 5 focus on the case of quadratic cost function, which allows us to 
prove a second order smooth fit principle. This leads to the missing information to explicitly 
individuate the value function and the optimal boundary (the third main result), and makes the 
results of Section 4 applicable. Finally, we close the paper by explicit illustrations of the theory 
to the basic example of geometric Brownian motion for the uncontrolled demand diffusion. More 
examples and applications are developed in the companion paper [2] where we also take into 
account delay in the expansion of the capacity production. 

2 The singular stochastic control problem 

Let us fix a probability space (fi, J^, P) equipped with a filtration F = {J-'t)t>o satisfying the 
usual conditions, and supporting a standard one-dimensional Brownian motion {Wt)t>o- On 
this space, we consider an uncontrolled state process D = {Dt)t>o (representing the demand of 



^There are of course several papers, which consider singular stochastic control problems with multidimensional 
state variables, and characterize the value function in terms of viscosity solutions to the associated HJB equations. 
However, rather few go beyond the viscosity characterization, and investigate smooth-fit properties in order to 
derive the structural form of the value function. In this spirit, we may mention the paper [16] in the case of 
just one dimensional controlled variable. See also [18] for impulse control of multi-dimensional diffusion processes 
with non degenerate diffusion term. On the other hand, we may quote the paper [2^, which studies regularity of 
a two-dimensional singular control problem with nondegenerate diffusion. 

''Another major advantage of such approach is that it allows generalizations. With this regard, we notice that 
here we minimize a cost functional and that we are in an irreversible investment environment. However, the 
arguments used here can be extended to the case of profit/cost functional and reversibility of investment, as in 

[21 (SB- 



a good), governed by a regular diffusion dynamics: 

dDt = fi{Dt)dt + a{Dt)dWt, Do = d. (2.1) 

Throughout the paper we assume the following. 

Assumption 2.1. (i) The coefficients fi,a are continuous, have at most linear growth, i.e. 
there exist constants Cf^, C^ such that 

Hd)\ < C^{l + \d\), \a{d)\ < C^{l + \d\), VdGE, (2.2) 

and are such that there exists a unique solution to (j2.ip on {^,T, {J-'t)t>o,P). 
(a) The solution takes values in some open interval 

^ — \y"mim Oimax j 1 CC ^ Umin ^ "-max _; +00. 

with not-exit boundaries dmin, dmax (in the sense of Feller's classification, see [^ Ch. II]). More- 
over, we also assume that the boundary dmin is not-entrance (and consequently natural, see again 
B Ch.IIJ). 
(Hi) The diffusion is nondegenerate, i.e. cr'^{d) > for all d £ O. 

Next, we consider a control process / = (/t)t>o, which is a cadlag nondecreasing F-adapted 
process. It represents the cumulative irreversible investment done from time up to time t > 0. 
We denote by X the set of such control processes / s.t. /q- = 0. The production capacity 
process {Ct)t>o, controlled by / G X, is given by 

Ct = c + It, Co-=ceR. (2.3) 

The objective is to minimize over / € X the functional 



E 



J"e-P'[g{Ct,Dt)dt + qodIt)], (2.4) 



where 5 : M x O — > [0, 00) is a running cost function, go > is the cost per unit of investment, 
and /9 is a positive discount factor. Notice that with respect to the usual irreversible investment 
literature, which is mainly based on profit/cost performance criterions, we focus here on the 
minimization of a cost criterion in the spirit of a social planning problem, whose objective is 
to fit the capacity production to the demand at cheapest cost, see [2] for a detailed description 
and explanation. Actually, we shall make the following assumptions on the cost function g. 

Assumption 2.2. (i) g is continuous onMx O, g{-,d) is strictly convex for all d £ O, and 
a-semiconcave with a € (0, 1] uniformly with respect to d £ O, meaning that there exists Mq > 
such that for every A G [0, 1], c,c' G M and d € O, 

Xg{c,d) + {l-X)g{c',d)-g{Xc + {l-X)c,d) < MoA(l - A)|c - cf +". (2.5) 

(ii) The partial derivative function gc{c, •) is nonincreasing in O for every c £M. 
(Hi) g satisfies a polynomial growth condition: there exist Cq > i' > 0, such that 

g{c,d) < Co(l + |c|^ + |d|^), VcGM, deO. 



Remark 2.1. 1. The a-semiconcavity property (|2.5p is verified if and only if g{-,d) € 
C^+"(M;E+) uniformly m d e O, in the sense that g{-,d) G Ci(M;M) for every d e O and 
and gc{-,d) is a-Holder continuous uniformly in (i € C This is consequence of Propositions 
2.1.2 and 2.1.3 in [9]. 

2. We observe that Assumption I2.2l -(ii) has an economic interpretation. It means that the 
marginal cost with respect to capacity for a fixed level of capacity is nonincreasing in the demand: 
since this marginal cost measures the instantaneous convenience to invest a unit of capacity, 
this assumption says that if the demand is going to increase, it becomes more convenient to 
invest. 

3. Any function g of the spread |c — (i| between capacity and demand, in the form 

g{c,d) = Co|c-d|i+", C7o>0, ae(0,l], (2.6) 

satisfies Assumption 12.21 D 

Remark 2.2. Following the idea of [5j Sec. 6], our model admits a suitable generalization to 
the case of capacity dynamics in the form: 

dCt = Ct{b dt + -f dWJ^) + dit, Co- = c, 

where W^ is another Browinan motion independent of W. Indeed letting C^ be the solution to 

dCO = C0(6dt + 7dO, C^ = 1, 

the process C can be rewritten as 

Ct = C^[c + It], with It = I ^dls, 
and the problem becomes 

" y " e-'^' (5(C7° [c + It],Dt)+ qoC^dlt 



inf E 
lei 



This problem involves an additional uncontrolled state variable (the variable C^), but keeps 
the basic structures, so it seems approachable by the same techniques developed in the next 
sections. □ 

3 Some properties of the optimal boundary 



We shall study the optimization problem (|2.4p by dynamic programming methods, and so 
consider this singular stochastic control problem when varying initial data. Therefore, from 
now on, we stress the dependence of C on c, / and the dependence of D on d by denoting them 
respectively as C^'^ , W^. Although the economic problem is meaningful for positive c, we also 
allow for mathematical convenience negative values of c. The state space is then equal to 

S = MxO. 



Given (c, d) G iS, the functional to be minimized over / G X is 



G{c,d;I) = E 

and the associated value function is 

v{c, d) = 



-pt 



■iC,I T^d 



g{Ci^\Df)dt + qodIt 



inf G(c,d;I), (c,d) eS. 



(3.1) 



Notice that ti > as g > 0. On the other hand, taking the null control / = 0, we have an upper 
bound for the value function: 



v{c,d) < V{c,d) := E 



e-'''g{c,Df)dt 



(3.2) 



Under (j2.2p . and by standard estimates, we know that that there exist positive constants Kq 
Ko,p,a,u, Ki = -firi,^,CT,v such that 



E 



\D: 



d\v 



< Ko{l + |dr)e^i*, Vt > 0. (3.3) 

In the sequel, we make the standing assumption that the discount factor p satisfies 

P > Ki, (3.4) 

where Ki is the constant appearing in ()3.3p . It is then easy to check with (j3.3p that V, and 
hence also v inherits from g the polynomial growth condition in Assumption I2.2t -(iii): there 
exists Co = Co,^,CT,j/ s.t. 

< v{c,d) < V{c,d) < C7o(l + |c|'' + ldl''), V(c,fi)G5, (3.5) 

which implies in particular that the value function v is finite and locally bounded. 

We next show directly some preliminary regularity properties on V and on the value function. 

Lemma 3.1. The function V belongs to the class C^+"'^(5;]R), meaning that it is once di- 
fferentiable with respect to c with a- Holder continuous derivative, and twice differentiahle with 
respect to d. Moreover, Vc is continuous on S. 

Proof. First, we notice by standard arguments that V{-,d) is convex. Now, let A G [0,1], 
c, c' G M, d G O, and set ca = Ac+ (1 — \)c' . Recalling Assumption 12 . 21 (i) . we have 

\V{c, d) + (1 - \)V{c', d) - y(cA, d) 



E 



-pt 



^Jo 



Xg{c, Df) + (1 - X)g{c', Df) - g{cx, Df)) dt 



< MoA(l-A) 



e-P*|c-cV+"dt 



Mo 
P 



A(l-A)|c-c 



/ 1 1+« 



which shows that V is a-semiconcave in c (uniformly w.r.t. d). Together with the convexity of 
V{., d), and by Proposition 2.1.3 in [9], this shows that V is once differentiable with respect to c 
with a-H61der continuous derivative. Twice differentiability with respect to d is a consequence 



of the fact that the diffusion is nondegenerate, as by standard theory V{c, •) solves a uniformly 
elliptic equation on O. 

Moreover, by dominated convergence, it is possible to differentiate under the integral sign 
in (j3.2p and get the representation 



r f°° 
Vcic,d) = E / e-P'gc{c,Df)dt 
'-Jo 



Then, by similar arguments, one obtain the twice differentiability of Vc with respect to d. Finally, 
continuity of Vc in the couple (c, d) is consequence of its local Lipschitz continuity with respect 
to d and its a-Holder continuity with respect to c. □ 

Proposition 3.1. The value function v is convex with respect to c and a-seniiconcave with 
respect to c uniformly in d G O. Hence, v{-,d) G C^"'""(M;R) uniformly in d G O. 

Proof. Convexity of v follows from the convexity of g with respect to c and linearity of the 
state equation for C^'^ . Let us now prove the semiconcavity property. Let e > 0, A G [0, 1], 
c, c' £ M., d G O, set ca = Ac + (1 — A)c', and take an e-optimal control P £ I for {c\, d). Due 
to Assumption 12 . 21 - (i) . we have 

Xv{c, d) + {l- \)v{c', d) - v{cx, d) < XG{c, d; P) + (1 - \)G{c' , d; P) - G{cx, d; P) + e 

POO 

< MoA(l-A) / e-''*|c-cf+"dt + e 
Jo 

= ^A(l-A)|c-cf+- + £. 
P 

By arbitrariness of e, this shows the required semiconcavity property. The last claim follows by 
convexity and a-semiconcavity of v{-,d), by using again Proposition 2.1.3 in [9]. □ 

Proposition 3.2. The following properties hold true: 

(i) Vc{-, d) > —qo for each d £ O. 

(a) Vc{c, ■) is nonincreasing for each c G M. 

Proof, (i) Let (c, d) £ S and, for each I £l, e > 0, set I^ := I + e. Then we have 

G{c,d;I)-v{c-e,d) > G{c,d;I) - G{c - e,d-I^) = -qoe. 

Taking the infimum over I £l, dividing by e and letting e — )■ 0, we get the required inequality 

for Vc- 

(ii) Fix (c, d') £ C and set a = Vc{c, d'). Then for every 6 > there exist e > such that 

v{c,d')-v{c-£,d') 
> a — 0. 

e 

By taking /^ G X an e(5-optimal control for (c — e, d'), we then get 

G{c,d';I)-G{c-e,d';P^) > e{a-26), V/ G X. (3.6) 



Now, under Assumption I2.2l -(ii). we have 

g{c,d)-g{c',d) > g{c,d') - g{c' ,d'), Vc, c' G E, Vd < d', 

which combined with (j3.6p yields 

G{c,d;I)-G{c-e,d;P^) > e{a-2d), VJ G Z, Vd < d', 

and so: 

G{c,d;I)-v{c-e,d) > e{a-26), yi £l,yd<d'. (3.7) 

Taking the infimum on / E Z in (j3.7p . we then get 

v{c,d) -v{c-e,d) > e{a-26), yd<d\ 

which shows by convexity of v{-,d) that 

Vc{c,d) > {a -25), yd<d'. 

By arbitrariness of 5, this means Vc{c,d) > Vc{c,d'), for all d < d' , which ends the proof. □ 

In view of Proposition 13.21 (i). we introduce the so-called continuation region 

C := {{c,d) G S I Vc{c,d) > -qo}, 

and its complement set, the action region 

A := {{c,d) G S I Vc{c,d) = -qo}. (3.8) 

Let us then consider the function c : O ^ M defined by 

c(d) := inf{c G M | Vc{c,d) > —qo}, 

with the convention inf = oo, inf M = — cc. Actually, since v{-,d) is convex and nonnegative, 
we notice that c{d) < oo for all d € O. Then, by convexity of v with respect to c, the action 
and continuation regions are expressed in terms of the free boundary function c as: 

C = {{c,d) eS \c> c{d)}, A = {{c,d) eS \c<c{d)}. (3.9) 

o 

We denote by C the topological interior of C (at this stage we do not know yet that C is open) 
and by C its topological closure in S. It is clear that 

C D {{c,d) g5 I c>c{d)}. (3.10) 

We also introduce the functions Cg and Cy from O into [—00,00) defined by: 

Cg{d) = inf{c G M | gc{c,d) > -pqo}, Cy{d) = inf{c G M | Vcic,d) > -qo}- 

One easily checks that they are nondecreasing (by Assumption I2.2l -(ii)) and right-continuous 
(by continuity of gc, Vc). 



Proposition 3.3. The function c is nondecreasing and c^ < c < c„. 



Proof. Monotonicity. The nondecreasing property of c is a consequence of the nonincresaing 
monotonicity of d i— )■ Vc{c, d) (Proposition I3.2i -(ii)). 

Estimate from above. Let d ^ O and c > Cg{d). Then there exists e > such that c — e > Cg{d). 
By definition and right-continuity of Cg , and by Assumption 12.21 (ii) , there exist d > d and 5 > 
such that 



gdC, v) > -PQo + ^, VC > c - e, V?7 < d. 
Let us consider the stopping time 

r = inf{t >0\ Df >d} > a.s. 
By (j3.1ip and the mean value theorem, we then have 



(3.11) 



yc,I nrf 



cj 



g{Ct'\Dt)-g{c-e,Dt) > {-pqo + S){C^'' - c + e), Vte[0,r). 



(3.12) 



Given an arbitrary / € Z, define If = {It + e)lt>T, and notice that C^' = Cj: ^' , for all t > t. 
We then have 



G{c,d;I) -G{c-e,d;I' 



-icJ 



e-PHg{C/,Dt)dt + q,dh 



E 



e~P'g{c - 8, Df)dt + e-f^qoilr + e) 







yCj 



e~P'{g{CJ^\Df)-gic-e,Dt))dt 



e-P'(g{Cf,Dt)-g{c-e,Dl 



dt 



+ E 
+ E 





P% 



e-P*qodIt-e~P^qo{Ir + e) 
e-P^Itdt - e-P^qoe 



(3.13) 



where we used integration by parts in the last equality. By plugging (j3.12p into ()3.13p . and 



C,I 



since It = C^' — c, we get 



G{c,d-I)-G{c-e,d;P) > -eqo + e6E 



-P'dt 



^Jo 



and so 



G{c,d;I) -v{c-e,d) > {-qo + 6')e, 



(3.14) 



where we set 6' = (5E[ JJ^ e ^*dt] > 0. Taking the infimum over / S Z in ()3.14p . and dividing by 
e, we get 



v{c,d) — v{c — e,d) 



> -qo + S' 



which combined with the convexity of v{-,d), shows that Vc{c,d) > —qo- This proves that 
c > c{d), and so the required upper bound for c{d). 

Estimate from below. Recall by convexity of g{-, d) that 



gid + r,d)-g{c,d) > g{c + r,d) - g{c,d), ^c > c, W > 0, ^d £ O. (3.15) 



Let d £ O and c > c{d). Then by definition of c{d) and convexity of v{-,d), there exist £,5 > 
such that 

v{c,d) — v{c — e,d) > e{—qo + 26). 
Taking a control P € X, which is e(5-optimal for 'L'(c — e, d), we then obtain: 

G{c,d;P^)-G{c-e,d;P^) > e{-qo + d). (3.16) 

Now observe that C^'^'' = c + if, C^'^'^'' =c-e + lf. Then, from (l3T5]l and (fXTBD . we get 

V{c,d)-Vic-e,d) > e{-qo + S). 

Since V{-, d) is convex, this shows that Vc{c, d) > — q'o, which yields c > Cy{d), and the claim is 
proved. □ 

Let us define 

c := inf c((i), c := supc(d), 

and the pseudo-inverse function d of c defined on M by 

d(c) := inf{d G O | Wc(c,d) = -go}, (3.17) 

with the convention inf = dmax ■ We also introduce the c-section sets of the continuation region 

Sc ■■= {{c,d) \ de {dmin,d{c))}, c G M. 
We have the following result on the form of the continuation region. 
Proposition 3.4. (1) The function d is nondecreasing and linic^oo d{c) = dmax- 

(2) Sc is increasing in c, in the sense that Sc C Sc' if c < c' . 

(3) Sc 7^ ^ if and only if c> c. 

(4) Ifoc then Sc = {dmin,dmax), and if Sc = {drain, dmax) then c>c. 

(5) We have the representation 

C = \JSc. (3.18) 



Proof. (1) The fact that d is nondecreasing follows from monotonicity of Vc with respect 
to d. By monotonicity of d, the limit limc_s.+oo d{c) exists. Suppose by contradiction that 
limc_).+oo d{c) = d < dmax- Then, by monotonicity of Vc with respect to d, we have Vc{c, d) = —qo 
for each {c,d) G M x {d,dmax)- But this is not possible since v is nonnegative, so we have the 
claim. The assertion (2) is a direct consequence of the monotonicity of d, while assertions (3) 

o 

and (4) follow from the definition of c and c. Let us prove the last assertion (5). If (c, d) G C, 
then Vc > —qo in some suitable neighborhood of {c,d). Therefore, by definition of d{c) and 

10 



monotonicity of Vc with respect to d, this inipHes that (c, d) ^ Sc ^ % for some c G IR. Hence, 

o 

the inclusion C C IJceR ^c is proved. Conversely, let (c, d) be such that (c, d) € Sc for some 
c € M. By assertion (3), we notice that c> c. By definition of d, we get: Vc{c, ■) > —qq in some 
neighborhood of d. Together with the continuity of Vc with respect to c, and the monotonicity of 
Vc with respect to d, this shows actually that the inequality Vc > —go holds in some neighborhood 

o 

of {c,d). This proves the inclusion C 3 UceR'^c) and finally the required relation (13.18^ . □ 

4 Structure of the solution 

The dynamic programming equation for the singular stochastic control (j3.ip takes the form of 
a variational inequality: 

max {[Cv{c, ■)]{d) - g{c,d),-Vcic,d) -qo] = 0, {c,d) e S, (4.1) 

where the second-order differential operator C is defined by 

[Cip]{d) = pip{d)-^,{d)ip'{d)-^a{dfip"{d). 

In the following, given a locally bounded function </> : M ^^ M, we denote respectively by (p* , 
and 93* the upper semicontinuous and the lower semicontinuous envelope of cj). Since we do not 
know a priori if there exists a smooth solution to (|4.ip , we first rely in general on the notion of 
viscosity solutions, whose definition in our context is given by: 

Definition 4.1. (i) We say that v is a viscosity suhsolution to (j4.ip if for any {c,d) € S, 

may: {[Cip{c, ■)]{d) - g{c,d),-ipc{c,d) -qo} < 0, 

whenever ip(c, .) G C^(M;M) and v{c, •)* — (p{c, •) has a local maximum at d. 
(ii) We say that v is a viscosity supersolution to ()4.ip if for any {c,d) G <S, 



max 



{\CLp{c,-)]{d) - g{c,d),-ipc{c,d) -qo] > 0, 



whenever ip{c, .) G C^(M;M) and v{c, •)* — (p{c, •) has a local minimum at d. 

(Hi) We say that v is a viscosity solution to (j4.ip if is is both a viscosity sub- and supersolution. 

The viscosity property of the value function follows usually from the dynamic programming 
principle (DPP). The statement of DPP calls upon delicate measurable selection arguments. 
Once we know a priori that the value function is continuous, measurable selection holds true 
and follows by classical arguments, see e.g. J15j . However, since we are not assuming Lipschitz 
continuity of the coefficients in (j2.ip . is it not clear how to get the continuity of the value 
function from its very definition. Instead, we can use the concept of weak dynamic programming 
introduced in [8], which holds for our problem, and then derive by standard arguments of 
stochastic control (see e.g. (26j Ch. 4]) the viscosity property of the value function. 

Proposition 4.1. The value function v is a viscosity solution to (14. ip on S. 
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Remark 4.1. One could prove a comparison principle to the variational inequality (j4.1|) for 
viscosity sub-and super solution satisfying the growth condition (j3.5p . hence providing a unique- 
ness viscosity characterization of the value function v. However, we can avoid such comparison 
principle issue in our approach relying mainly on the viscosity property in order to derive a 
smooth-fit property, which then allows us to identify uniquely the value function. D 

Remark 4.2. Since the value function v is continuously differentiable w.r.t. the argument c 
(Proposition 13. ip . the viscosity property of v to (j4.ip implies in particular the following viscosity 
property on the continuation region (where Vc > —Qo)'- 

[Cv{c,-)]{d)-g{c,d) = 0, {c,d)eC. (4.2) 

D 

We now investigate the structure of the value function v in the continuation region C and in 
the action region A, and state some topological properties of these sets. Let us denote respec- 
tively by Ip and if the strictly positive, increasing and strictly positive, decreasing fundamental 
solutions to the linear ordinary differential equation 

C^id) := pcPid)-fiid)cl>'{d)-^a{d)^"{d) = 0, 
which satisfy 

^(d+in) = 0, ^«,J = oo, (4.3) 

since dmin is a natural boundary. The existence and properties of such functions can be found 
in several references including Chapter 2 in [7]. 

Lemma 4.1. Let c> c, and d defined by (j3.17p . Then 

v{cr) G C°((d™„,d(c)];M) n C\{dminJ{c)y,R). 
Moreover there exist constants A{c),B{c) € M such that 

v{c, d) = A{c)^{d) + B{cMd) + V{c, d), d e {dmin, d{c)]. (4.4) 

Proof. Fix c > c and [a, b] C (dmin, d{c)], and consider the Dirichlet problem 



jpu{d) - p{d)u'{d) - \a{dfu"{d) = g{c, d), d G (a, 6), 
\^u{a) = v{c,a), u{b) = v{c,b). 



(4.5) 



This problem admits a unique viscosity solution, which must coincide with v{c, •) in [a, b] 
from (j4.2p . On the other hand, by uniform ellipticity of a, problem ()4.5p admits a solution 
of class C°([a,6];M) n C^{{a,b);R). Hence, we deduce that v{c,-) G C°((dmm, ti(c)];M) n 
C^((dmm, d(c));M), and satisfies in a classical sense: 

[Cv{c,-)]{d) - g{c,d) = 0, d e {dmin, die)). 
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Moreover, notice that V{c, .) is a particular solution to the family of nonhoniegeneous ODEs 
parametrized by c € M: 

[Cct){c,-W)-g{c,d) = 0. (4.6) 

Therefore the general solution to (j4.6p is in the form: 

A{c)'ilj{d) + B{cMd) +V{c,d), 

for some real-valued constants A{c), B(c), which proves the structure of v in the continuation 
region, i.e. (j4.4p . D 

Lemma 4.2. The following properties hold: 

(i) \midid^^„ (v(c, d) - y(c, d)) = 0, for all c> c. 

(a) If c < oo, then v{c, d) = V{c, d) for all c> c and d & O. 

(Hi) If c = oo, then limc^oo('y(c, d) — V{c, d)) = 0, for all d £ O. 

Proof, (i) Fix c > c. By Lemma |4. II v(c. •) € C'^{{dmin,d{c));^), and satisfies in a classical 
sense 



[£.v{c,-)]id) - g{c,d) = 0, yd e {dmin,d{c)). 



(4.7) 



Let d € {drain, d{c)) and consider the stopping time r^ = inf{t > | Df > d{c)}. Since dmin is 
a not-entrance boundary for the diffusion D, we have (see e.g. [TJ Chll, Sec. 10]): 



Td / OO a.s. 



when d \^ dn 



(4.^ 



By ()4.7p and definition of r^, Ito's formula applied to u(c, LJf ) in the interval [0, r^) yields 



i;(c, d) 



E 



T"d 



e-''*5(c, Z)f )dt + e-f"^v[c, d{c)) 



> E 



Td 



e-P'gic,Df)dt 



'- JO 



Subtracting y(c, d) in both sides of the inequality above, we get 

r /""^ 
v{c, d) - V{c, d) > E e-P^g{c, Df)dt 

Taking the liminf for d J, dmin , and using (|4.8p , we obtain 

liminf(z;(c,d) -t>(c,d)) > 0, 

and so the required limiting result since we always have v < V (see ()3.2p ). 

(ii) Fix c > c. Recalling (13.91) . we then see that (c, d) lies in C for all d G C Thus, v{c, .) satisfies 
in a classical sense: 



[Cv{c,-)]id)-gic,d) 



0, Vd G O. 
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Thus, by applying Ito's formula to v{c, Df) between t = and T > 0, we have: 

v{c,d) = ]e[ / e-P^g{c,Df)dt\+K[e-P'^v{T,D!^)]. (4.9) 

Now, from ()3.3p - (j3.4p - (j3.5p . we easily see that K[e~P'^v{T,D^)'j converges to zero as T goes 
to infinity. Therefore, by sending T to infinity into ()4.9p . and using monotone convergence 
theorem, we deduce that v{c,d) = V{c,d). 

(iii) Suppose that c = oo. By Proposition I3.4I -(1). we have d{c) /^ dmax when c /^ oo. Let 
us consider the stopping time Tc = inf{i > j Df > d{c)}, which satisfies Tc /^ go a.s. when 
c /^ oo, since dmax is not-exit (see e.g. [3 Ch. II, Sec. 10]). Then, by arguing as in the proof of 
item (i) (with Tc in place of r^), we obtain the desired claim. D 

We can now provide the complete structure of the value function. Let us define 

d := inf{d G O \ c{d) > -oo}. 

Theorem 4.1. (Structure and properties of the value function) 
There exist functions A : (c, oo) — t- M, z : {d,dmax) —^ ^, such that 

JA{c)^id)+Vic,d) onC, 

v[c,d) = < (4.10) 

\^—qoc + z{d), on A, 

Moreover: 

(i) The function A lies in C-^((c, oo);M), and satisfies 



A{c) < 0, c G {c,c), 
A{c) = 0, c>c, 



(4.11) 



(with the convention \mic^aoA{c) = in the case c = ooj. Furthermore, if there exists 
d £ O such that c{d) = c, then A can be extended to a function C^{\c, oo);M). 

(ii) z can be written in terms of v and c as 

z{d) = v{c{d),d)+qoc{d). (4.12) 

(iii) The function c is right- continuous on {d,dmax) and C is open. 

Proof. Structure of v in C. By Lemma 14.11 and (j3.18p . we already know that there exist 
functions A, B : (c, oo) -^ M such that 

v{c,d) = A{c)ij{d) + B{c)ip{d) + V{c,d), in C • 

Moreover, from Lemma 14.21 (i) and (j4.3p . we must have B{c) = 0. This proves the structure 

v{c,d) = A{c)i'{d) + V{c,d), in C . (4.13) 

Let us now check that such structure also holds at the points of the boundary 3C|j Since c is 
nondecreasing, if (c, d) G dC, then one of the following case should hold: 



dC is intended as the boundary of C in 5. 
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(a) d = d{c) < dmax, 

o 

(b) c = c{d) and {(c, d) \ c> c{d)} C C, 

(c) d{c') = d{c) for c' G (c, c + e) for some e > 0. 

In the case (a) the form ()4.13|) holds by Lemma |4.1[ In the case (b) the structure (|4.13p holds 

o 

by continuity of v with respect to c and by the already proved structure in C- In the case (c) 
the structure (|4.13|) holds by case (a) and by continuity of v with respect to c. In any case, we 
have proved that 

v{c,d) = A{c)^l;{d) + V{c,d), in C. (4.14) 

Structure of v in A. This follows directly from the definition ()3.8p of A. 

Let us now prove the remaining properties. 
(i) The property that A G C-^((c, oo); M) is consequence of the fact that V{-,d) as well as v{-,d) 
(see Proposition 13. ip lie in C""^ ( (c((i), oo);M), together with the fact that ip{d) > for d G O. 
Let us prove (j4.1ip . First of all, we see that A < 0, since v < V and ip > 0. The fact that 
A{c) = 0, for c> c follows from Lemma 14.21 (ii). We prove now that A{c) < for c G (c, c). Fix 
some c G (c, c). One can find do < dmax such that c < c{do). Since c < Cg and g{-, do) is strictly 
convex there exist £,6 > such that 

9c{C,do) < -pqo-6, \/Ce[c,c + e]. 

Together with Assumption 12.21 (11). we then get 

gc{^,d) < -pqo-6, V^ G [c,c + e],V(i > do, 
and so 

g{c + e,d) < g{c,d) + {-pqo-S)e, Vd > do. (4.15) 

Let d > do and consider the stopping time Td ■= inf{t > | Df < do}- Since dmax is not-exit, 
we know that Td /^ oo almost surely when d goes to dmax (see [3 Ch. II, Sec. 10]). Assume now 
on the contrary that A{c) = 0, so that v{c,d) = V{c,d) for all d G O. Take the control If = e, 
so that 

v{c,d) < E e~P^g{c + e,Df)dt + qoe + e-P''''v{c + e,do) 

'-Jo 

Combining with ()4.15p . we then get 

v{c, d) < e\ [ ' e~P^g{c, Df)dt + {-pqo - 5)£ ^ ~ ^ ^ + qos + e~P^''v{c + e, do) 

Taking the limit for d t dmax-, we get the required contradiction: v[c, d) < V[c-, d) — e5/ p. 

On the other hand, suppose that there exists d G O such that c{d) = c. Then by continuity 
of Vc with respect to c we have 

lim(yl'(c)V(d) + T4(c,d)) = -go. 

c4,c 

15 



Since V'(^) > 0, this implies that there exists a finite linicicA'^c), and therefore A can be 
extended to a function C^([c, oo);M). 



(ii) Relation ()4.12p follows from continuity of v{-,d) (Proposition 13. ip . using ()4.10p and evalu- 
ating V at {c{d), d) G A. 

(in) Let do > d and let ((i„)n>i be a sequence s.t. dn i d^. We denote by cq = limn-~>-oo c{dn) ■ 
This limit exists by monotonicity of c and is larger than c((io)- Hence, we only need to check 
that Co is smaller than c{do)- By definition of A and c{dn), the point {c{dn)-,dn) lies on A, so 



Vc{c{dn),dn) = -qo, Vn > 1. 
Moreover, by (j3.10p . {c{dn),dn) also lies in C, so 

(co,(io) = lim {c{dn),dn) G C. 



(4.16) 



(4.17) 



Now, as consequence of Lemma |3. II and ()4.14p . the function Vc is continuous on C. Therefore, 
by (|iJ6]) and dHZD, we have: 

Vc{co,do) = -qo, 

which proves that (co,(io) € A, i.e. c{do) > cq, and so the right-continuity of c. Finally, the 
fact that C is open follows from right-continuity and monotonicity of c. □ 



The second main result provides the existence and an explicit description of the optimal 
irreversible investment. 

Theorem 4.2. (Optimal control) 

Let (c, d) S S, and consider the process I* £ Z defined by 



It 



c ( sup D, 

Q<s<t 



Then I* is an optimal control for the value function at (c, d) . 

Proof. Fix (c, d) G S, and denote by C* = C"^'^* the capacity process starting from c and 
controlled by /* € X. We claim that 

(a) {C;,Df) G C, a.s. for ah t > 0, 

(b) Jo°°e-Pn^^c:,Df)eC}^^ = 0, a.s. 

Indeed, by monotonicity of the function c, we have 



c: 



c + 



c( sup Dg) - c 

■ 0<s<t 



> c{Df), 



which shows (a) by (j3.10p . Let us now prove the assertion (b). Fix oj £ il. and suppose that 
{C^{uj),Df{u;)) G C, i.e. C;(w) > c{Df{uj)) by I^M)- We distinguish two cases: 
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(i) c(supq<j,<( -Df (cj)) > c. In this case we have 



c sup Di{u) 

^0<s<t 



and by nionotonicity of c this means that 



C:{u) > c{Df{u)), 



sup Di{uj) > Df{uj). 

0<s<t 

Then, by continuity of D {uj), we deduce that r i— )■ supQ<j,<j, Dj (w) is constant in the 
interval [t, t + e(a;)) for some e(a;) > 0, and the same holds true for r i— ?> I*{uj) by definition 
of/*. 

(ii) c (supo<s<( Dg{u)^ < c. In this case we have 



Hence, by monotonicity and right-continuity of c, and by continuity of D [lo), there exists 
some e(cj) > s.t. 

c > sup c{Df.{uj)). 

t<r<t+e{uj) 

Together with the assumption of this case, this yields c > supo<r<i+£(tj) K^ri^))^ ^^^ ^o- 
/;(a;) = for all r G [0, i + e(w)). 

In any case, we have shown that, if {C^,Df) € C, then /* is constant in a right (stochastic) 
neighborhood of t, which shows (b). Now let Af be the (at most countable) set of discontinuity 
points of c. Due to continuity of supo<s<t D^ and by definition of /*, 

(c) the jumps A/^* = AC^* of I^ and C^ occur only in the following cases: 

— either at time when c < c{d), and in this case A/g = c{d) — c; 

- or when Df G M and C^L* < c{Df), and in this case A/^* = c{Df) - C*_. 

Let us now prove that 

-pti 



v{c, d) > E 



e - 5(c;,A') + 9od/; 



(4.18) 



Consider the (bounded) stopping time r„, = inf{t > | Q* A Df > n} A n, and notice that 
Tn /^ oo a.s. when n goes to infinity. From (j4.14p . we see that v € C^'^(C;M). Thus, by the 
assertion (a), we may apply Ito's formula (see Theorem 32, pag. 79, in [27]) to e~''^v{C^ ,Df) 
between and r^, take expectation, and obtain (after observing that the stochastic integral over 
the interval [0, r„ A T) vanishes in expectation): 



v{c,d) 



E 



-pTn 



v{a 



Dt 



ii: 



T„AT^-^T„AT 



+ E 



e-^'[Cv{C:,-)]{Df)dt 



(4.19) 



e~P'v,{C:,Df)di: 



[ Y^ e^^\viC:,Df)-viC:-,Df)-v,iC:,Df)AC:) 

0<t<T„ 
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Now observe that [Cv[c' , ■)]{<!') = g{c',d') for {c',d') in C but also in C by continuity of g and 
(j4.14p . Together with (a) this impUes that 



E 



e-P%v{C:,-)]{Df)dt 



^Jo 



E 



-p<i 



By (b) and since Vc = —Qq in A^ we have 



E 



e-P'v,{C:,Df)di; 



E 



5(c;,A')dt 



-''*god/; 



Moreover, by (c) we have 

v{Cl, Df) - v{C*- , Df) - Vc{C;,Df)AC; = 0, a.s., Vt > 0. 
Therefore by nonnegativity of v and (j4.19p , we have 

vied) > e\ r e~P\g{C;,D'})dt + qodIl) 



^JQ 



By sending n to infinity, and from monotone convergence, we get the inequahty (|4.18p . Since 
the opposite inequality always hold by definition of v, this proves the equality, i.e. that /* is an 
optimal control. □ 

The picture below represents a possible shape of the solution. The state space region S is 
the half-plane on the right of the vertical dotted line. When the system lies in the continuation 
region C, it moves along the horizontal lines and no action is taken. Whenever the system 
touches the boundary dC, the optimal control (acting along the vertical lines as indicated by 
the arrows in the picture) consists in investing the minimal amount of money to keep the system 
in C. 
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5 The quadratic case: second-order smooth fit and explicit so- 
lution 

Theorem 14.11 and continuity of v, v^ with respect to c yield a couple of optimality conditions. 
Indeed, the functions A,c,z must satisfy for every d S {d,dmax)'- 



(i) A{c{d))i;{d)+V{c{d),d) = -qoc{d) + z{d), 



(5.1) 



(ii) A'{cid))^id) + VMd),d) 



-go- 



It is clear that one cannot expect that the two conditions above provide a way either to find the 
value function or just the optimal boundary c, as they relate three functions by two equations. A 
third condition is needed and should be derived from some other suitable smoothness property 
of the value function at the optimal boundary. To this end, we notice by Theorem 14. II that 



Q o 

—Vc{c,d) = in A- 



(5.2) 



Therefore, a requirement of a smooth fit condition of the second order mixed derivative of v at 
the optimal boundary would imply 



lim Vcd{c,d) 

cl.c{d) 



0, yd G {d, d„ 



(5.3) 



(Remark 15. II below makes this point more precise). 

The purpose of the present section is indeed to prove (j5.3p . However, we need to further 
specify our assumptions, restricting to the quadratic cost case: 



g{c,d) 



2^o{d)c + ao{d)), 



(5.4) 



where ao,/3o are continuous functions. Within this section we assume that g has the structure 
(|5.4p and we do not repeat this assumption in the statements of the results. We assume that 
the function /3o is nondecreasing, so that Assumption r2.'2l -(ii) holds true, and we denote by 



a{d) := E / e-P^ao{Df)dt , /3{d) := E / e-P^Po{Df)dt 



(5.5) 



and notice that a, f3 ^ C'^{{dmin,dmax)',^) as the diffusion D is nondegenerate. The function V 
is written in this case as: 



Given a function w € 



V{c,d) = l(-c^-2/3{d)c + a{d) 
2 \p 

R), let us denote by 



(5.6) 



1 



[w{x + e) + w{x — e) — 2w{x)], x G M, e > 0. 



The following Lemma, which relies on assumption (|5.4p . enables us to obtain further regularity 
of the value function with respect to c (Corollary 15. ip . which is crucial to prove then (|5.3p . 
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Lemma 5.1. We have 

< [A'^v (■,(!)]( c;e) < -, Vc G M, Ve > 0, Vd G O. 

P 

Proof. The estimate from below is a straightforward consequence of the convexity of v with 
respect to c. Let us prove the estimate from above. Let (c, d) £ S, e > and I £ Z. By using 
the fact that gcc = 1 under (j5.4p . we have 

^ [G(c + e, d; I) + G(c - e, d; I) - 2G(c, d; I)] (5.7) 

°° r ^ \ 1 1 



P 



- poo |- 1 , 

Since 

v{c + e,d)+v{c-£,d)-2G{c,d-J) < G{c + e,d;I) + G{c - e,d;I) -2G{c,d;I), 
we get from (j5.7p : 

^ [t;(c + e, d) + v(c - e, d) - 2G(c, d; I)] < -, Vc e M, Vd € O, Ve > 0. 
e^ p 

Taking the supremum over I (^Z, this proves the required upper-estimate. □ 

Lemma 15.11 imphes that Vc{-,d) is Lipschitz continuous for each d £ O. Together with 
Theorem 14. H we immediately get the following regularity result. 



Corollary 5.1. The derivative function A' : {c,oo) — ?• M, where A is the function defined in 
Theorem \^.l\ is locally Lipschitz. In other terms A € Wj^'^((c, cx));M). 

We are now able to prove the second order smooth-fit result on the value function. 
Proposition 5.1. The relation (|5.3|) holds true: 

\\m. Vcd{c,d) = 0, yde{d,dmax)- 

Proof. Let us consider the function w defined on (c, oo) x O by 

w{c,d) := A{c)i^{d) + V{c,d). 
We have w = v over C, so the claim is equivalent to prove that 

lim Wcd{c, d) = 0, Vd € O. 

cl.c{d) 

We notice that the limit above always exists and coincides with Wcdic{d),d) due to continuity 
of Wed (see Theorem 14. ip . Suppose by contradiction that there exists do ^ {d,dmax) such that 
the limit above is different from 0, in which case, by Proposition 13. 2l -(ii). we should have 

Wcd{cido),do) < 0. (5.8) 
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Due to right continuity of c (Proposition 14. iK iiil ) . we may find di > do such that c is continuous 
in [do, di]. Under (j5.8p and by continuity of Wcd, we may find e > and d2 G {do, di) such that, 
denoting by cq = c{do), c^ = c{d2), we have 

Wcd{c,d) < -e, V(c,d) G [co,C2] X [do,(i2]- 
Consider now the function w{c,d) = w{c,d) + qoc, and observe that we have as weh 

Wcd{c,d) < -e, V(c,<i) G [co,C2] X [(io,<i2]. (5.9) 

Moreover, by definition of c, we have 

Wc{c{d),d) = 0, VdG[do,(i2]- (5.10) 

We then have the following facts: 

1. From (j5.9p . the function c is strictly increasing in the interval [doit?2] and therefore can 
be inverted. The inverse function d = c~^ : [00,02] — )• [do)'^2] is continuous and strictly 
increasing as well. 

2. By (j5.10p . and Corollarv 15.11 we can apply a (generalized) implicit function theorem to 
Wc and get in a generalized sense 

.1,00/r. .i.rj JIN i//„N _ Wccio,d{o)) 



deW^'°^{[oo,02];[do,d2]), d'{o) 



Wcd{c,d{o)) 
with 

. esssupcg[ ]u;cc(c,d(c)) 

\\d 00 < =: Me < 00. 

e 

3. By item 2, d is absolutely continuous. Hence, by using also item 1, we see that the set 

M := {cG(co,C2) I 3 J'(c)G(0,M,]} 
has full Lebesgue measure in [cq, C2]. 

4. Denoting by 

d{M) = {d = d{o) I c G AA}, 
we see by the above items that 

(i) d{N) is dense in [^0,^2], 

(ii) c is differentiable at each d G d{J\f), (^-H) 

(iii) c'{d) G [l/Me,oo), Vd G d(AA). 
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Let us now consider the function d G [do)'^2] ^ v{co,d). Since c is nondecr easing, the segment 
{{co,d) I d € [do,c?2]} is contained in A. Hence, Theorem 14.11 yields 

f (co, d) = -qoco + z{d). (5.12) 

Apply the chain rule at the points of d[N) to 

[(io,(i2] ^^ M, d h^ z{d) = v{c{d),d) + qoc{d) = w{c{d),d) + qoc{d). 

Then, the function z is differentiable at the points of d{J\f) and 

z'{d) = Wc{c{d),d)c'{d) + Wd{c{d),d)+qoc{d), yd £ d{M). 

By definition of c, we have: Wc{c{d),d) = Vc{c{d),d) = —go for every d G O, and so 

z'{d) = Vd{cid),d), ydediAf). 

Together with (|5.12p . this shows the existence of Vd(co, d) for each d E d{M) and the equality 

Vd{co,d) = z'{d) = Wdic{d),d), ydGd{M). (5.13) 

On the other hand, by using the same argument for the use of the chain rule, we can get from 
(j5.13p the existence of v^dico, d) for each d S d{N') and the equality 

Vddico,d) = z"{d) = Wddicid),d) + Wcd{c{d),d)c'{d), yd £ d{M). 

Therefore, from (|5.9p . we get 

Vdd{co,d) < Wddic{d),d)-e/M„ yded{Af). (5.14) 

Now the viscosity subsolution property of v and (|5.12p - (j5.13p - (|5.14p yield 

pvico,d)-^l{d)wd{c{d),d)-^aidf[wddic{d),d)-e/^'Q < gico,d), yd e diM). (5.15) 

Taking a sequence (a„) C d{M) such that a„ J, do (this can be done by (|5.1ip -(i)) and passing 
to the limit in (I5.15P evaluated at d = an we obtain: 

pv{co,do) - fJ,{do)wd{co,do) - -a{dof[wdd{co,do) - e/Me] < g{co,do). (5.16) 

On the other hand, recall that Cw = g on C, as v = w therein. Therefore, since w G C"^'^(5;M) 
and since (co,do) ^ dC, by continuity of g we must also have 

pv{co,do) - fi{do)wd{co,do) - -a{do)^Wdd{co,do) = g{co,do), 

which is in contradiction with (j5.16p as a^{dQ) > 0, and the claim is proved. □ 

Proposition 15.11 can be used to add a third condition to (|5.ip : indeed, by (j4.14p . the relation 
(lOjl yields 

A'{c{d))i,'{d) + V,d{c{d),d) = 0, yde{d,dmax), 
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so that the functions A, c, z must satisfy for ah d € {d, dmax) 

'(i) A{c{d))i;{d) + V{c{d),d) = -qoc{d) + z{d), 

(ii) A'{c{d))tPid) + Vc{c{d),d) = -go, 



(5.17) 



^(iii) A'{c{dW{d) + Vcd{c{d),d) = 0. 

This is a set of necessary optimahty conditions, which are sufficient for identifying the value 
function. 



Theorem 5.1. The functions c,A,z of Theorem \4.1\ are determined as follows: 
(a) The optimal boundary function c is explicitly given by 

deO. 



c{d) = p 
(b) The function A is given by^ 

A{c) 



^(") - Wt/^'^ - ^°^'' 



(5.18) 



P'{d{i)) 



d^, c^{c,c), 



where d is the pseudo-inverse of c. 
(c) The function z is equal to 

z{d) = A{c{d))^{d)+V{c{d),d)+qoc{d). 



(5.19) 



(5.20) 



Proof, (a) Multiplying ()5.17l) -(iii) by ijj/il)' and subtracting to (I5.17p -(ii). we get ()5.18p . 

(b) Prom (j5.17p -(iii). (j4.1ip and the expression (|5.6p of F, we get (j5.19p by integration. 

(c) The last equality (jOOl) is derived from (a)-(b), and (fET]) -fi). D 

Remark 5.1. 1. As consequence of Theorem 15. 1^ we see that the optimal boundary c is 
continuous (and actually smooth), and so 

A = {(c,d) g5 I c<c{d)}. 
Then, Proposition 15.11 together with (j5.2p yield 

\\m Vcd{c,d) = \mi Vcd{c,d), ^de{d,dmax), 

c\,c{d) c\c{d) 

which shows clearly the smooth-fit of the mixed second derivative of the value function. 

2. We observe that (15.17P also implies the continuity of Vd, Vdd at dC. Indeed, differentiating 
()5.17p -(i) with respect to d and subtracting ()5.17p -(ii) multiplied by c'{d) we get 

A{c{d)W{d) + VMd),d) = z'{d), 



'It can be eventually extended by continuity to c and c, if they are finite. 
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which means the continuity of Vd at dC. Then, differentiating (j5.21|) with respect to d and 
subtracting (j5.17p -(iii) multiphed by c'(d), we have 

A{c{d))r{d) + Vdd{c{d),d) = z"{d), 

meaning the continuity of v^d at dC. □ 



Remark 5.2. We comment now about possible relaxing of assumption (j5.4p . A first natural 
question arising is if the smooth fit principle stated in Proposition 15.11 is true even without 
assuming that structure for g. As we have outlined at the beginning of this section, assumption 
(j5.4p allows to obtain a good regularity of the value function with respect to c needed in the 
proof of Proposition 15.11 On the other hand, we are quite confident that it holds also in other 
cases, maybe the proof passing through other arguments. 

Supposing to have a positive answer to this first question, a second natural question is if 
this smooth fit principle is still sufficient to uniquely individuate the value function together 
with the other optimality conditions. The optimality conditions (j5.17p remain the same, so the 
question just corresponds to ask if uniqueness of solutions holds for the system. Arguing as in 
the proof of item (a) of Theorem 1 5. H one has to deal, for given d & O with the solvability with 
respect to c of 

tj^V^a{c,d)-Vc{c,d) = go- (5.21) 

We already know that there is a solution to the equation above for each d > d, as c{d) must 
solve this equation (since it is derived from necessary conditions of optimality). Therefore the 
question reduces to the problem of uniqueness of solutions to (|5.2ip (at least in the interval 
{—oo, Cg{d)], as by Proposition 13.31 we know that c{d) < Cg{d)\ observe also that Cg{d) is in 
principle easily computable). Once one knows that this uniqueness holds true, then one can still 
argue as in the remaining proof of Theorem 15.11 to get the complete expression of the functions 
A^ z individuating the value function. D 

A basic example: the GBM case 

We end this paper by a simple and explicit illustration of our Theorem l5.1l to the case when the 
demand is modeled as a geometric Brownian motion: 

dA = AiAdt + aDtdWt, /i e M, cr > 0, 

with initial datum d > 0. In this case O = (0, oo). Moreover, assume that 

9{c,d) = -{c-df, 
and, according to Assumption 13.41 assume that 

p>2/i + o-^ (5.22) 
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Then V is the quadratic function equal to 

Vic,d) = K^ ^d'-^dc+^c'). 

The increasing fundamental solution to 

[£(t>]{d) := p(l)-fid4>'-^a^cf4>" = 0, 
is given by 

ipid) = d"" 
where m is the positive root of the equation p — pm — 2 o'^?Ti(m — 1) = 0, and explicitly given by 



Notice that m > 2 by (|5.22p . From Theorems 14.11 and 15.1^ the value function v has the explicit 

form 

^ ,^ (A{c)d"' + V{c,d), on did), 

v{c,d) = < 

[— (/oc+ z((i), on c < c{d). 

where the functions A, c, z are given by 

c{d) = ad — b, d > 0, 

m-l 1 

Mc) = , ^ (c + 6)2— , o-b, 

m[m — m — 2) p — p 

z{d) = A{ad-b)dJ^ + V{ad-b,d) + qo{ad-b), d>0, 



with 

m — 1 p 

a = , b = pqo. 

m p — p 
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